Magnification Observation Device, Magnification Observation Method, And Magnification Observation Program

ABSTRACT

Provided are a magnification observation device, a magnification observation method, and a magnification observation program in which connected image data can be efficiently obtained in a short period of time when re-imaging an object to obtain the connected image data corresponding to a plurality of unit regions. A plurality of unit regions on a surface of an observation object are imaged, and a plurality of pieces of image data respectively corresponding to the plurality of unit regions are generated. An image of the object including the plurality of unit regions is displayed as a region presentation image. When any of the plurality of unit regions is selected by a selection instruction from a user, the selected unit region is re-imaged, to generate image data corresponding to the selected unit region as re-imaged data.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application claims foreign priority based on Japanese PatentApplication No. 2011-188704, filed Aug. 31, 2011, the contents of whichis incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a magnification observation device, amagnification observation method, and a magnification observationprogram.

2. Description of Related Art

Japanese Unexamined Patent Publication No. 2008-139795 discloses afluorescence microscope system in which images of a plurality of regionsof an object are joined together to generate one synthetic wide-regionimage. According to this fluorescence microscope system, it is possibleto obtain an image of a wider region of an object than a regioncorresponding to a visual field of an object lens with the lowestmagnification.

In the above fluorescence microscope system, for example, a sampleplacement part placed with an object can be moved, and a plurality ofregions of the object can be imaged, to thereby obtain a plurality ofimages. Thereafter, the obtained plurality of images are joinedtogether. This leads to generation of a synthetic wide-region image, andthe generated synthetic wide-region image is displayed in a displaypart.

When part of the plurality of images is not appropriately obtained atthe time of generating the synthetic wide-region image, a user can viewthe generated synthetic wide-region image, to thereby recognize thatpart of the regions has not been appropriately imaged. In this case, theuser performs re-imaging on all the regions to regenerate a syntheticwide-region image.

However, with increase in the number of regions to be imaged, the timerequired for re-imaging the plurality of regions and the time requiredfor generating a synthetic wide-region image become longer.

SUMMARY OF THE INVENTION

It is an object of the present invention to provide a magnificationobservation device, a magnification observation method, and amagnification observation program in which, in the case of re-imaging anobject to obtain connected image data corresponding to a plurality ofunit regions, the connected image data can be efficiently obtained in ashort period of time.

(1) According to one embodiment of the invention, there is provided amagnification observation device which images an object to display animage of the object, the device including: an imaging part thatrespectively images a plurality of unit regions of an object on apreviously set imaging condition, to generate a plurality of pieces ofimage data respectively corresponding to the plurality of unit regions;a positional information generating part that generates positionalinformation indicative of respective positions of the plurality of unitregions; a storage part that stores the plurality of pieces of imagedata generated by the imaging part along with the positional informationgenerated by the positional information generating part; a connectingpart that connects the plurality of pieces of image data stored into thestorage part, to generate connected image data; a display part thatdisplays images of the object including the plurality of unit regions asa region presentation image; an accepting part that accepts from a usera selection instruction for selecting any of the plurality of unitregions with the region presentation image being displayed by thedisplay part; and a control part that controls the imaging part so as togenerate image data corresponding to the selected unit region byre-imaging the selected unit region on an imaging condition differentfrom the previously set imaging condition based on the selectioninstruction accepted by the accepting part and the positionalinformation stored into the storage part, and stores the image datagenerated by the re-imaging into the storage part replaceably with theimage data corresponding to the selected unit region among the imagedata corresponding to the plurality of unit regions stored into thestorage part.

In the magnification observation device, a plurality of unit regions ofan object are respectively imaged on a previously set imaging condition,to generate a plurality of pieces of image data respectivelycorresponding to the plurality of unit regions. Further, there isgenerated positional information indicative of respective positions ofthe plurality of unit regions. The generated plurality of pieces ofimage data are stored along with the positional information, and thestored plurality of pieces of image data are connected, to generateconnected image data.

An image of the object including the plurality of unit regions isdisplayed as a region presentation image. In this state, when any of theplurality of unit regions is selected by a selection instruction fromthe user, the selected unit region is re-imaged based on positionalinformation on an imaging condition different from the previously setimaging condition, to generate image data corresponding to the selectedunit region. The image data generated by the re-imaging is storedreplaceably with the image data corresponding to the selected unitregion among the image data corresponding to the stored plurality ofunit regions. Hence, the image data corresponding to the selected unitregion can be replaced with the stored image data, to thereby generatethe connected image data corresponding to the plurality of unit regions.This can eliminate the need for re-imaging all the unit regions evenwhen an image of part of the plurality of unit regions is notappropriately obtained. Consequently, in the case of re-imaging theobject to obtain connected image data corresponding to the plurality ofunit regions, the connected image data can be efficiently obtained in ashort period of time.

Further, since the re-imaging is performed on the imaging condition foreach unit region which is different from the previously set imagingcondition, the image data corresponding to the selected unit region isreplaceable with the image data generated by re-imaging on the imagingcondition different from the previously set imaging condition.Therefore, when an imaging condition for part of the unit regions is notappropriate, an image of that unit region can be obtained on anappropriate imaging condition.

(2) When the selection instruction is accepted by the accepting part,the control part may replace the image data corresponding to theselected unit region among the image data corresponding to the pluralityof unit regions stored in the storage part with the image data generatedby the re-imaging.

In this case, the image data corresponding to the selected unit regionamong the stored image data corresponding to the plurality of unitregions is replaced with the image data generated by the re-imaging.This eliminates the need for the user to perform an operation forreplacing the image data. Consequently, in the case of re-imaging theobject, the connected image data including the image data generated bythe re-imaging can be obtained with ease.

(3) The accepting part may further accept from the user an adjustmentinstruction for adjusting the imaging condition of the imaging part toan imaging condition different from the previously set imagingcondition, and when the selection instruction is accepted by theaccepting part, the control part may control the imaging part so as toperform the re-imaging on the imaging condition adjusted in accordancewith the adjustment instruction, thereby generating image data.

In this case, by the adjustment instruction from the user, re-imagingcan be performed while the imaging condition for each unit region isadjusted to an imaging condition different from the previously setimaging condition. This allows replacement of the image datacorresponding to the selected unit region with the image data generatedby the re-imaging on the adjusted imaging condition. Therefore, when animaging condition for part of the unit regions is not appropriate, animage of that unit region can be obtained on an appropriate imagingcondition.

(4) Every time image data corresponding to one unit region is generated,the connecting part may sequentially connect the generated image data topreviously generated image data corresponding to another unit region,and the display part may sequentially display images of a plurality ofunit regions as the region presentation image based on the image datasequentially connected by the connecting part.

In this case, every time image data is generated, the images of theplurality of unit regions are sequentially displayed as the regionpresentation image in the display part. The user can view the regionpresentation image displayed in the display part, to thereby select withease a unit region that needs re-imaging. Further, the user canrecognize with ease which region among the plurality of unit regions isa currently imaged unit region.

(5) When the selection instruction is accepted by the accepting part,the control part may control the connecting part so as to suspendconnection of image data.

In this case, the selection instruction is accepted during the timeuntil all the unit regions are imaged, to suspend the connection of theimage data. This prevents connection of a plurality of pieces of imagedata including inappropriate image data from being continued. Hence, thewasteful time in generation of the connected image data is deleted.Consequently, appropriate connected image data can be efficientlygenerated.

(6) The imaging part can image the object at a first magnification and asecond magnification lower than the first magnification, and mayrespectively image the plurality of unit regions at the firstmagnification to generate a plurality of pieces of image datacorresponding to the plurality of unit regions, and the display part maydisplay, as the region presentation image, images based on image datagenerated by imaging at the second magnification by the imaging part.

In this case, it is possible to display the region presentation image bymeans of a small capacity of image data. This eliminates the need forspending a long period of time on generation of image data fordisplaying the region presentation image. Further, it is possible toprevent an amount of image data for displaying the region presentationimage from exceeding a usable capacity of an operation memory.

(7) The control part may automatically set the previously set imagingcondition for imaging each unit region based on image data generated byimaging each unit region before imaging on the previously set imagingcondition, and determine whether or not the imaging condition for eachunit region has been normally set, and the control part may control thedisplay part so as to display in the region presentation image anindicator for identifying an image of a unit region determined not tohave been normally set with the imaging condition.

In this case, since the imaging condition for each unit region isautomatically set, each unit region is imaged on an appropriate imagingcondition without the user performing an operation for adjusting theimaging condition. Further, the user can view the indicator displayed onthe region presentation image, to thereby recognize with ease the imageof the unit region having not been normally set with the imagingcondition. Therefore, the unit region can be selected based on theindicator, to thereby re-image with ease the unit region determined notto have been normally set with the imaging condition.

(8) The magnification observation device may further include adetermination part which determines whether or not the image of eachunit region satisfies the previously set condition based on the imagedata corresponding to each unit region, and the control part may controlthe display part so as to display in the region presentation image anindicator for identifying an image of a unit region having beendetermined by the determination part not to satisfy the previously setcondition.

In this case, the user can view the indicator displayed on the regionpresentation image, to thereby recognize with ease the image of the unitregion in which an image satisfying the previously set condition has notbeen obtained. Therefore, the unit region can be selected based on theindicator, to thereby re-image with ease the unit region in which animage satisfying the previously set condition has not been obtained.

(9) The imaging part may sequentially image the plurality of unitregions to sequentially generate image data corresponding to each unitregion, and the control part may control the imaging part so as tosequentially re-image the unit region selected based on the selectioninstruction accepted by the accepting part and subsequent unit regions,thus generating image data corresponding to the selected unit region andthe subsequent unit regions.

In this case, the selected unit region and the subsequent unit regionsare sequentially re-imaged. Therefore, when images are obtained whichare not appropriate with respect to the plurality of unit regions, theselected unit region and the plurality of subsequent unit regions arere-imaged by the user issuing a one-time selection direction. Thissimplifies the operation for the selection instruction for the unitregion, performed by the user.

(10) According to another embodiment of the invention, there is provideda magnification observation method for imaging an object to display animage of the object, the method including the steps of: respectivelyimaging a plurality of unit regions of an object on a previously setimaging condition, to generate a plurality of pieces of image datarespectively corresponding to the plurality of unit regions; generatingpositional information indicative of respective positions of theplurality of unit regions; storing the generated plurality of pieces ofimage data along with the generated positional information; connectingthe stored plurality of pieces of image data, to generate connectedimage data; displaying images of the object including the plurality ofunit regions as a region presentation image; accepting a selectioninstruction for selecting any of the plurality of unit regions with theregion presentation image in a displayed state; and generating imagedata corresponding to the selected unit region by re-imaging theselected unit region on an imaging condition different from thepreviously set imaging condition based on the accepted selectioninstruction and the stored positional information, and storing thegenerated image data replaceably with the image data corresponding tothe selected unit region among the image data corresponding to theplurality of stored unit regions.

In the magnification observation method, a plurality of unit regions ofan object are respectively imaged on a previously set imaging condition,to generate a plurality of pieces of image data respectivelycorresponding to the plurality of unit regions. Further, there isgenerated positional information indicative of respective positions ofthe plurality of unit regions. The generated plurality of pieces ofimage data are stored along with the generated positional information,and the stored plurality of pieces of image data are connected, togenerate connected image data.

An image of the object including the plurality of unit regions isdisplayed as a region presentation image. In this state, when any of theplurality of unit regions is selected by a selection instruction fromthe user, the selected unit region is re-imaged based on positionalinformation on an imaging condition different from the previously setimaging condition, to generate image data corresponding to the selectedunit region. The image data generated by the re-imaging is storedreplaceably with the image data corresponding to the selected unitregion among the image data corresponding to the stored plurality ofunit regions. Hence, the image data corresponding to the selected unitregion can be replaced with the stored image data, to thereby generatethe connected image data corresponding to the plurality of unit regions.This can eliminate the need for re-imaging all the unit regions evenwhen an image of part of the plurality of unit regions is notappropriately obtained. Consequently, in the case of re-imaging theobject to obtain connected image data corresponding to the plurality ofunit regions, the connected image data can be efficiently obtained in ashort period of time.

Further, since re-imaging is performed on the imaging condition for eachunit region which is different from the previously set imagingcondition, the image data corresponding to the selected unit region isreplaceable with the image data generated by the re-imaging on theimaging condition different from the previously set imaging condition.Therefore, when an imaging condition for part of the unit regions is notappropriate, images of those unit regions can be obtained on appropriateimaging conditions.

(11) According to still another embodiment of the invention, there isprovided a magnification observation program for causing a processingapparatus to execute a process of imaging an object to display an imageof the object, the program including the processes of respectivelyimaging a plurality of unit regions of an object on a previously setimaging condition, to generate a plurality of pieces of image datarespectively corresponding to the plurality of unit regions; generatingpositional information indicative of respective positions of theplurality of unit regions; storing the generated plurality of pieces ofimage data along with the generated positional information; connectingthe stored plurality of pieces of image data, to generate connectedimage data; displaying images of the object including the plurality ofunit regions as a region presentation image; accepting a selectioninstruction for selecting any of the plurality of unit regions with theregion presentation image in a displayed state; and generating imagedata corresponding to the selected unit region by re-imaging theselected unit region on an imaging condition different from thepreviously set imaging condition based on the accepted selectioninstruction and the stored positional information, and storing the imagedata generated by the re-imaging replaceably with the image datacorresponding to the selected unit region among the image datacorresponding to the plurality of stored unit regions.

In the magnification observation program, a plurality of unit regions ofan object are respectively imaged on a previously set imaging condition,to generate a plurality of pieces of image data respectivelycorresponding to the plurality of unit regions. Positional informationindicative of respective positions of the plurality of unit regions isalso generated. The generated plurality of pieces of image data arestored along with the generated positional information, and the storedplurality of pieces of image data are connected, to generate connectedimage data.

An image of the object including the plurality of unit regions isdisplayed as a region presentation image. In this state, when any of theplurality of unit regions is selected by a selection instruction fromthe user, the selected unit region is re-imaged based on positionalinformation on an imaging condition different from the previously setimaging condition, to generate image data corresponding to the selectedunit region. The image data generated by the re-imaging is storedreplaceably with the image data corresponding to the selected unitregion among the image data corresponding to the stored plurality ofunit regions. Hence, the image data corresponding to the selected unitregion can be replaced with the stored image data, to thereby generatethe connected image data corresponding to the plurality of unit regions.This can eliminate the need for re-imaging all the unit regions evenwhen part of the plurality of unit regions is not appropriatelyobtained. Consequently, in the case of re-imaging the object to obtainconnected image data corresponding to the plurality of unit regions, theconnected image data can be efficiently obtained in a short period oftime.

Further, since re-imaging is performed on the imaging condition for eachunit region which is different from the previously set imagingcondition, the image data corresponding to the selected unit region isreplaceable with the image data generated by re-imaging on the imagingcondition different from the previously set imaging condition.Therefore, when an imaging condition for part of the unit regions is notappropriate, an image of that unit region can be obtained on anappropriate imaging condition.

According to the present invention, in the case of re-imaging an objectto obtain connected image data corresponding to a plurality of unitregions, the connected image data can be efficiently obtained in a shortperiod of time.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing a configuration of a magnificationobservation device according to a first embodiment;

FIG. 2 is a perspective view showing a microscope of the magnificationobservation device according to the first embodiment;

FIG. 3 is a schematic view showing a state where an imaging unit of themicroscope is fixed parallel to a Z-direction;

FIG. 4 is a schematic view showing a state where the imaging unit of themicroscope is inclined at a desired angle from the Z-direction;

FIG. 5 is a view showing a display example of a display part at the timeof imaging an observation object;

FIG. 6 is a view showing another display example of the display part atthe time of imaging the observation object;

FIG. 7 is a view showing a display example of the display part during amagnification observation process according to the first embodiment;

FIG. 8 is a view showing a display example of the display part duringthe magnification observation process according to the first embodiment;

FIG. 9 is a view showing a display example of the display part duringthe magnification observation process according to the first embodiment;

FIG. 10 is a view showing a display example of the display part duringthe magnification observation process according to the first embodiment;

FIG. 11 is a view showing a display example of the display part duringthe magnification observation process according to the first embodiment;

FIG. 12 is a flowchart of a magnification observation process accordingto the first embodiment;

FIG. 13 is a flowchart of the magnification observation processaccording to the first embodiment;

FIG. 14 is a view showing a display example of the display part during amagnification observation process according to a second embodiment;

FIG. 15 is a flowchart of the magnification observation processaccording to the second embodiment; and

FIG. 16 is a flowchart of the magnification observation processaccording to the second embodiment.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS [1] First Embodiment

A magnification observation device, a magnification observation method,and a magnification observation program according to a first embodimentwill be described with reference to the drawings.

(1) Configuration of Magnification Observation Device

FIG. 1 is a block diagram showing a configuration of a magnificationobservation device according to the first embodiment.

Hereinafter, two directions orthogonal within a horizontal plane aretaken as an X-direction and a Y-direction, and a vertical direction(perpendicular direction) to the X-direction and the Y-direction istaken as a Z-direction.

As shown in FIG. 1, a magnification observation device 300 is providedwith a microscope 100 and an image processing apparatus 200.

The microscope 100 includes an imaging unit 10, a stage unit 20, and arotational angle sensor 30. The imaging unit 10 includes a color CCD(charge coupled device) 11, a half mirror 12, an object lens 13, a zoomadjusting part 13 a, a magnification detecting part 13 b, an A/Dconverter (analog/digital converter) 15, an illumination light source16, and a lens driving part 17. The stage unit 20 includes a stage 21, astage driving part 22, and a stage supporting part 23. An observationobject S is placed on the stage 21.

The illumination light source 16 is, for example, a halogen lamp or awhite light LED (light-emitting diode) which generates white light.White light generated by the illumination light source 16 is reflectedby the half mirror 12, and thereafter collected by the object lens 13onto the observation object S on the stage 21.

The white light reflected by the observation object S is transmittedthrough the object lens 13 and the half mirror 12, and incident on thecolor CCD 11. The color CCD 11 has a plurality of pixels for red thatreceive red wavelength light, a plurality of pixels for green thatreceive green wavelength light, and a plurality of pixels for blue thatreceive blue wavelength light. The plurality of pixels for red, theplurality of pixels for green, and the plurality of pixels for blue aretwo-dimensionally arrayed. From each of the pixels in the color CCD 11,an electric signal corresponding to a light receiving amount isoutputted. The output signal of the color CCD 11 is converted to adigital signal by the A/D converter 15. The digital signal outputtedfrom the A/D converter 15 is sequentially provided as image data to theimage processing apparatus 200. Instead of the color CCD 11, an imagingelement such as a CMOS (complementary metal oxide semiconductor) imagesensor may be used.

In the present embodiment, the object lens 13 is a zoom lens. The zoomadjusting part 13 a changes a magnification of the object lens 13 bycontrol of the image processing apparatus 200. The magnificationdetecting part 13 b detects the magnification of the object lens 13, andprovides a detection result to the image processing apparatus 200.Thereby, the magnification of the object lens 13 is adjustable by theimage processing apparatus 200 to an arbitrary magnification within afixed range. It is to be noted that the zoom adjusting part 13 a may beoperated by the user, to adjust the magnification of the object lens 13.In this case, the adjusted magnification of the object lens 13 isdetected by the magnification detecting part 13 b, and provided to theimage processing apparatus 200.

Further, the object lens 13 is provided movably in the Z-direction. Thelens driving part 17 moves the object lens 13 in the Z-direction bycontrol of the image processing apparatus 200. Thereby, a focal positionof the imaging unit 10 moves in the Z-direction.

The stage 21 is rotatably provided on the stage supporting part 23around an axis in the Z-direction. The stage driving part 22 moves thestage 21 in an x-direction and a y-direction, described later,relatively with respect to the stage supporting part 23 based on amovement command signal (drive pulse) provided from the image processingapparatus 200. The stage driving part 22 uses a stepping motor. Therotational angle sensor 30 detects a rotational angle of the stage 21,and provides the image processing apparatus 200 with an angle detectionsignal indicating the detected angle. In the image processing apparatus200, based on the response signal from the stage driving part 22 withrespect to the movement command signal and the angle detection signalfrom the rotational angle sensor 30, a position of the stage 21 in theX-direction and the Y-direction and a rotational angle thereof areacquired.

The image processing apparatus 200 includes an interface 210, a CPU(central processing unit) 220, a ROM (read only memory) 230, a storageunit 240, an input unit 250, a display part 260, and an operation memory270.

A system program is stored into the ROM 230. The storage unit 240 ismade up of a hard disk and the like. In the storage unit 240, alater-described magnification observation program is stored, and avariety of data such as image data provided from the microscope 100through the interface 210 are also stored. A detail of the magnificationobservation program will be described later. The input unit 250 includesa keyboard and a pointing device. As the pointing device, a mouse, ajoystick, or the like is used.

The display part 260 is configured, for example, by a liquid crystaldisplay panel or an organic EL (electroluminescent) panel.

The operation memory 270 is made up of a RAM (random access memory), andused for processing a variety of data.

The CPU 220 executes the magnification observation program stored in thestorage unit 240, to perform image processing based on image data bymeans of the operation memory 270, and displays an image based on theimage data in the display part 260. Further, the CPU 220 controls thecolor CCD 11, the zoom adjusting part 13 a, the illumination lightsource 16, the lens driving part 17, and the stage driving part 22 ofthe microscope 100 through the interface 210.

FIG. 2 is a perspective view showing the microscope 100 of themagnification observation device 300 according to the first embodiment.In FIG. 2, the X-direction, the Y-direction, and the Z-direction areindicated by arrows.

As shown in FIG. 2, the microscope 100 has a base 1. A first supportingbase 2 is attached onto the base 1, and a second supporting base 3 isalso attached to the front surface of the first supporting base 2 so asto be embedded thereinto.

A connecting part 4 is rotatably attached to the top edge of the firstsupporting base 2 around a rotational axis R1 extending in theY-direction. A rotational column 5 is attached to the connecting part 4.Thereby, the rotational column 5 is inclinable within a vertical planeparallel to the Z-direction with the rotational axis R1 taken as afulcrum point in association with rotation of the connecting part 4. Theuser can fix the connecting part 4 to the first supporting base 2 bymeans of a fixing knob 9.

A circular supporting part 7 is attached to the front surface of aconnecting part 6. A substantially tubular imaging unit 10 is attachedto the supporting part 7. In the state of FIG. 2, a light axis R2 of theimaging unit 10 is parallel to the Z-direction. The supporting part 7has a plurality of adjustment screws 41 for moving the imaging unit 10within a horizontal plane. It is possible to adjust a position of theimaging unit 10 such that the light axis R2 of the imaging unit 10vertically intersects with a rotational axis R1 by means of theplurality of adjustment screws 41.

A slider 8 is attached, slidably in the Z-direction, to the frontsurface of the second supporting base 3 on the base 1. An adjustmentknob 42 is provided on the side surface of the second supporting base 3.A position of the slider 8 in the Z-direction (height direction) isadjustable by an adjustment knob 42.

The stage supporting part 23 of the stage unit 20 is attached onto theslider 8. The stage 21 is rotationally provided around a rotational axisR3 in the Z-direction with respect to the stage supporting part 23.Further, the x-direction and the y-direction intersecting with eachother within the horizontal plane are set on the stage 21. The stage 21is provided movably in the x-direction and the y-direction by the stagedriving part 22 of FIG. 1. When the stage 21 rotates around therotational axis R3, the x-direction and the y-direction of the stage 21also rotate. This leads to inclination of the x-direction and they-direction of the stage 21 within a horizontal plane with respect tothe X-direction and the Y-direction.

An imaging range (visual field range) of the imaging unit 10 variesdepending on a magnification of the imaging unit 10. Hereinafter, theimaging range of the imaging unit 10 is referred to as a unit region.The stage 21 can be moved in the x-direction and the y-direction, tothereby acquire image data of a plurality of unit regions. The imagedata of the plurality of unit regions can be connected, to therebydisplay images of the plurality of unit regions in the display part 260of FIG. 1.

Although the imaging range of the imaging unit 10 is referred to as theunit region in the present embodiment as thus described, the unit regionis not necessarily the imaging range of the imaging unit 10. Forexample, part of regions within the imaging range of the imaging unit 10may be taken as a unit region. In this case, the unit region is smallerthan the imaging range of the imaging unit 10.

FIG. 3 is a schematic view showing a state where the imaging unit 10 ofthe microscope 100 is fixed parallel to the Z-direction. Further, FIG. 4is a schematic view showing a state where the imaging unit 10 of themicroscope 100 is inclined at a desired angle from the Z-direction.

As shown in FIG. 3, with the rotational column 5 in a parallel state tothe Z-direction, the fixing knob 9 is fastened, to fix the connectingpart 4 to the second supporting base 3. Thereby, the light axis R2 ofthe imaging unit 10 vertically intersects with the rotational axis R1while being in a parallel state to the Z-direction. In this case, thelight axis R2 of the imaging unit 10 is vertical to the surface of thestage 21.

The fixing knob 9 is loosened to make the connecting part 4 rotatablearound the rotational axis R1, and the rotational column 5 inclinablewith the rotational axis R1 taken as a fulcrum point. Therefore, asshown in FIG. 4, the light axis R2 of the imaging unit 10 is inclinableat an arbitrary angle θ with respect to the Z-direction. In this case,the light axis R2 of the imaging unit 10 vertically intersects with therotational axis R1. Similarly, the light axis R2 of the imaging unit 10is inclinable at an arbitrary angle on the side opposite to the side inFIG. 4 with respect to the Z-direction.

Therefore, a height of the surface of an observation object on the stage21 can be made to agree with a height of the rotational axis R1, tothereby observe the same portion of the observation object in a verticaldirection and an oblique direction.

(2) Display Examples of Image of Observation Object at the Time ofImaging

In the following description, two magnifications, which are differentfrom each other within a certain range, of the object lens 13 adjustableby the zoom adjusting part 13 a of FIG. 1 are referred to as a firstmagnification and a second magnification. The second magnification islower than the first magnification.

FIG. 5 is a view showing a display example of the display part 260 atthe time of imaging the observation object S, and FIG. 6 is a viewshowing another display example of the display part 260 at the time ofimaging the observation object S.

As shown in FIGS. 5 and 6, an image display region 410, a conditionsetting region 420, and a pointer p are displayed on a screen of thedisplay part 260. At the time of imaging the observation object 5, animage based on image data is displayed in the image display region 410,and a first magnification set button 421, a second magnification setbutton 422 and a connection process button 423 are displayed in thecondition setting region 420.

With the observation object S being placed on the stage 21 of FIG. 1,the user operates the first magnification set button 421 by use of theinput unit 250 of FIG. 1. The zoom adjusting part 13 a is thuscontrolled, to adjust the magnification of the object lens 13 to thefirst magnification. As shown in FIG. 5, the CPU 220 displays an imagecorresponding to the unit region of the observation object S in theimage display region 410 of the display part 260.

The user operates the second magnification set button 422 by use of theinput unit 250 of FIG. 1. The zoom adjusting part 13 a is thuscontrolled, to adjust the magnification of the object lens 13 to thesecond magnification. As shown in FIG. 6, the CPU 220 displays an imagecorresponding to the unit region of the observation object S in theimage display region 410 of the display part 260.

As described above, the second magnification is lower than the firstmagnification. In this case, as shown in FIGS. 5 and 6, the unit regionin the case where the first magnification is set is smaller than theunit region in the case where the second magnification is set.

Therefore, in the case of changing the magnification of the object lens13 from the first magnification to the second magnification, the rangeof the image of the observation object S displayed in the image displayregion 410 can be enlarged. In FIG. 6, a dotted line is provided to aportion of images corresponding to the unit region of the observationobject S at the time when the magnification of the object lens 13 is thefirst magnification.

With the image being displayed in the display part 260, the user canmove the stage 21 in the x-direction or the y-direction, to therebychange the range of the images of the observation object S displayed inthe image display region 410.

The user operates the connection process button 423 by use of the inputunit 250 of FIG. 1. Thereby, a later-mentioned magnification observationprocess is started.

(3) Magnification Observation Process According to First Embodiment

As described above, in the magnification observation device 300according to the present embodiment, the stage 21 can be moved in thex-direction and the y-direction, to thereby acquire image data of aplurality of unit regions, and the image data of the plurality of unitregions can be connected, to thereby display images of the plurality ofunit regions in the display part 260 of FIG. 1. In this case, it ispossible to obtain images of the observation object S across a broadrange exceeding the unit regions. A process of connecting image data ofa plurality of unit regions and displaying the images of the pluralityof unit regions in the display part 260 as thus described is referred toas a magnification observation process. The user operates the connectionprocess button 423 of FIG. 5 or 6, to start the magnificationobservation process.

The magnification observation process started with the magnification ofthe object lens 13 being set to the first magnification, namely, themagnification observation process in the case of generating imagescorresponding to a plurality of unit regions at the first magnification,will be described with reference to FIGS. 7 to 11. FIGS. 7 to 11 areviews each showing a display example of the display part 260 during themagnification observation process according to the first embodiment.

When the user operates the connection process button 423 of FIG. 5, theCPU 220 of FIG. 1 acquires a digital signal provided from the A/Dconverter 15 of FIG. 1 as image data corresponding to a first unitregion, and stores the acquired image data as first image data into thestorage unit 240 of FIG. 1. At this time, the CPU 220 generates firstpositional information corresponding to the first image data andindicative of a position of the first unit region, and stores thegenerated first positional information into the storage unit 240 of FIG.1. Further, the CPU 220 displays an image r1 of the first unit region inthe display part 260 of FIG. 1 based on the acquired first image dataand first positional information.

The positional information may, for example, be generated based on theforegoing response signal from the stage driving part 22 (FIG. 1) to themovement command signal and the foregoing angle detection signal fromthe rotational angle sensor 30 (FIG. 1). In this case, the positionalinformation may be a coordinate of each unit region in the X-directionand the Y-direction. Further, in a case where imaged positions of theplurality of unit regions are previously set in imaging order, thepositional information may be the order of imaging.

Subsequently, the CPU 220 controls the stage driving part 22 of FIG. 1to move the stage 21 of FIG. 1 in the x-direction and the y-directionsuch that regions around the first unit region are imaged.

In the present example, a unit region adjacent to the first unit regionis imaged as a second unit region. The CPU 220 acquires a digital signalprovided from the AID converter 15 of FIG. 1 as image data correspondingto the second unit region, and stores the acquired image data as secondimage data into the storage unit 240 of FIG. 1. At this time, the CPU220 generates second positional information corresponding to the secondimage data and indicative of a position of the second unit region, andstores the generated second positional information into the storage unit240 of FIG. 1. Further, the CPU 220 connects the second image data tothe first image data stored in the storage unit 240, and displays animage r2 of the second unit region in the display part 260 of FIG. 1based on the acquired second image data and second positionalinformation.

It is to be noted that respective parts of the adjacent unit regions arepreferably set so as to overlap each other. In this case, it is possibleto perform pattern matching between a plurality of pieces of image datacorresponding to adjacent unit regions. The pattern matching can beperformed, to thereby sequentially connect the acquired image data tothe image data corresponding to the adjacent unit region.

In such a manner as above, there is repeated a series of operationsincluding movement of the stage 21, imaging of an n-th unit region (n isa natural number not less than 2), storage of image data and positionalinformation, connection of image data, and display of an image.Hereinafter, this series of operations is referred to as a connectedimage generating operation. The connected image generating operationsare repeated, to sequentially display images r1 to r6 of first to sixthunit regions in a spiral form in the image display region 410, forexample as shown in FIG. 7. In this state, a re-imaging button 424 and aconnection end button 425 are displayed in the condition setting region420.

In each of FIG. 7 and later-mentioned FIGS. 8, 10, and 11, in order tofacilitate understanding of a plurality of images which respectivelycorrespond to a plurality of unit regions being sequentially displayedin the display part 260, the image display region 410 is provided withdotted lines for partitioning the plurality of images corresponding tothe plurality of unit regions.

In the magnification observation process according to the presentembodiment, the re-imaging button 424 of FIG. 7 can be operated, tothereby selectively re-image any unit region among the plurality ofimaged unit regions. An operation at the time of re-imaging will bedescribed.

FIG. 8 shows a display example of the display part 260 in the case ofoperation of the re-imaging button 424 of FIG. 7. When the user operatesthe re-imaging button 424, the CPU 220 suspends repetition of theconnected image generating operation described above. Further, as shownin FIG. 8, the CPU 220 displays in the display part 260 the images r1 tor6 as a region presentation image based on the plurality of pieces ofimage data, which were connected until the suspension. At this time, theconnection end button 425 is displayed in the condition setting region420.

In this state, the user can select any of the plurality of images r1 tor6 displayed in the image display region 410 by use of the input unit250 of FIG. 1, to thereby select a unit region that needs re-imagingamong the plurality of unit regions corresponding to the plurality ofimages r1 to r6.

In the image display region 410, the pointer p is superimposed on any ofthe plurality of images r1 to r6, to display a selection frame HFsurrounding the image superimposed with the pointer p (image r6 in FIG.8). Thereby, the user can select with ease a unit region that needsre-imaging, while viewing the selection frame HF.

As described above, any of the plurality of images r1 to r6 is selected,to provide the CPU 220 with a signal indicative of a unit region of theselected image as a selection instruction.

In the example of FIG. 8, a star-shaped mark m included in the image r6of the plurality of images r1 to r6 is unclearly displayed. Thereat, theuser selects the image r6 by use of the input unit 250 of FIG. 1. Inthis case, the CPU 220 accepts a signal indicative of the unit region ofthe image r6 (sixth unit region), and controls the stage driving part 22of FIG. 1 to move the stage 21 of FIG. 1 based on the accepted selectioninstruction and the positional information (sixth positional informationin the present example) stored in the storage unit 240, so as to allowimaging of the sixth unit region.

Subsequently, the CPU 220 acquires a digital signal provided from theA/D converter 15 as image data corresponding to the sixth unit region,and displays in the display part 260 of FIG. 1 the image r6 of the sixthunit region based on the acquired image data.

FIG. 9 shows a display example of the display part 260 in the case wherethe image r6 of FIG. 8 is selected. As shown in FIG. 9, when the imager6 of FIG. 8 is selected, the image r6 is displayed in an entire regionof the image display region 410. Further, a re-imaging decision button426, a gain adjustment button 427 a, an exposure time button 427 b, awhite balance button 427 c, and a focus button 427 d are displayed inthe condition setting region 420.

In this state, the user can operate the gain adjustment button 427 a,the exposure time button 427 b, the white balance button 427 c, and thefocus button 427 d, to thereby adjust imaging conditions at the time ofre-imaging. Any of the gain adjustment button 427 a, the exposure timebutton 427 b, the white balance button 427 c, and the focus button 427 dis operated, to provide the CPU 220 with an adjustment instruction foradjusting the imaging condition.

The user operates the gain adjustment button 427 a. In this case, theCPU 220 accepts a gain adjustment instruction for the color CCD 11 ofFIG. 1 as the adjustment instruction for the imaging condition for theunit region. The CPU 220 increases or decreases the gain of the colorCCD 11 based on the provided gain adjustment instruction.

The user operates the exposure time button 427 b. In this case, the CPU220 accepts an adjustment instruction for exposure time as theadjustment instruction for the imaging condition for the unit region.The CPU 220 makes a shutter speed long or short based on the providedadjustment instruction for the exposure time.

The user operates the white balance button 427 c. In this case, the CPU220 accepts an adjustment instruction for white balance as theadjustment instruction for the imaging condition for the unit region.Based on the provided adjustment instruction for the white balance, theCPU 220 corrects a value of image data so as to change a colortemperature of an image displayed based on the image data.

The user operates the focus button 427 d. In this case, the CPU 220accepts an adjustment instruction for a position in the Z-direction ofthe object lens 13 (hereinafter, referred to as Z position) as theadjustment instruction for the imaging condition for the unit region.The CPU 220 controls the lens driving part 17 based on the providedadjustment instruction for the Z position, to move the object lens 13 inthe Z-direction so as to move a focal position of the object lens 13 inthe Z-direction.

The CPU 220 displays in the display part 260 of FIG. 1 the image r6 ofthe sixth unit region of the observation object S based on image dataacquired by imaging on an imaging condition after the adjustment. Inthis case, the user can adjust a variety of imaging conditions with easewhile viewing the image r6 displayed in the image display region 410.For example, the user can adjust the imaging condition with ease so asto make the star-shaped mark m, which is unclearly displayed in theexample FIG. 8, clearly displayed while viewing the image r6 shown inthe image display region 410.

In the following description, image data acquired by the re-imaging isreferred to as re-imaged data, and an image displayed in the displaypart 260 based on the re-imaged data is referred to as a re-imagedimage.

After the adjustment of the imaging condition for the unit region, theuser operates the re-imaging decision button 426 of FIG. 9 by use of theinput unit 250 of FIG. 1. Thereby, the CPU 220 re-images the sixth unitregion on the adjusted imaging condition. The CPU 220 stores the imagedata, acquired by the re-imaging as re-imaged data corresponding to thesixth unit region, into the storage unit 240 of FIG. 1. At this time,the CPU 220 generates sixth positional information corresponding to there-imaged data and indicative of a position of the sixth unit region,and stores the generated sixth positional information into the storageunit 240 of FIG. 1.

Further, the CPU 220 replaces the sixth image data, stored before there-imaging among the plurality of pieces of image data stored in thestorage unit 240 of FIG. 1, with the newly stored sixth re-imaged data.Moreover, the CPU 220 connects the sixth re-imaged data to the first tofifth image data.

Subsequently, based on the mutually connected first to fifth image dataand the sixth re-imaged data, the CPU 220 displays, in the display part260 of FIG. 1, the plurality of images r1 to r5 of the first to fifthunit regions and a re-imaged image r6 x of the sixth unit region.

The CPU 220 then resumes the suspended connected image generatingoperation when the next unit region is not an imaged unit region. On theother hand, when the next unit region is an imaged unit region, the CPU220 sequentially re-images the unit region and subsequent unit regionson the imaging condition after the adjustment, to sequentially acquirere-imaged data respectively corresponding to the unit region and thesubsequent unit regions, while storing positional informationcorresponding to the respective re-imaged data into the storage unit 240of FIG. 1. Further, the CPU 220 replaces the image data stored in thestorage unit 240 of FIG. 1 with the re-imaged data, and displays there-imaged image in the image display region 410.

FIG. 10 shows a display example of the display part 260 after operationof the re-imaging decision button 426 of FIG. 9. As shown in FIG. 10, inthe case of operation of the re-imaging decision button 426 of FIG. 9,after re-imaging of the sixth unit region, the above connected imagegenerating operation is resumed. In this case, after replacement of theimage r6 of FIG. 8 with the re-imaged image r6 x, subsequent unitregions are imaged, and images of the imaged unit regions aresequentially displayed in the image display region 410. In the exampleof FIG. 10, a seventh image r7 is displayed.

In the present embodiment, in the connected image generating operationafter the resumption, the subsequent unit regions are imaged on theimaging condition adjusted at the time of re-imaging. Thereby, there-imaging can lead to imaging of the subsequent unit regions on anappropriate condition. This is not restrictive, and in the connectedimage generating operation after the resumption, each unit region may beimaged on an imaging condition set at the time of start of themagnification observation process.

The user operates the connection end button 425 of FIG. 7, 8, or 10 byuse of the input unit 250 of FIG. 1. FIG. 11 shows a display example ofthe display part 260 when the connection end button 425 is operated atthe time of imaging of a 25th unit region. By the operation of theconnection end button 425, the CPU 220 completes the connected imagegenerating operation. In this case, as shown in FIG. 11, the CPU 220displays, in the display part 260, the images r1 to r5 and r7 to r25 andthe re-imaged image r6 x as connected images based on the connectedplurality of pieces of image data and re-imaged data. Further, the CPU220 stores into the storage unit 240 the connected image data generatedby mutual connection of the plurality of pieces of image datacorresponding to the plurality of unit regions and re-imaged data, tocomplete the magnification observation process. At this time, the CPU220 also stores into the storage unit 240 positional informationrespectively corresponding to the plurality of pieces of image data andthe re-imaged data which constitute the connected image data.

(4) Effects

In the present embodiment, a plurality of unit regions on the surface ofthe observation object S are imaged, and based on a plurality of piecesof image data obtained by the imaging, images of the plurality of unitregions are displayed in the display part 260.

In this state, by the operation of the re-imaging button 424 of FIG. 7,the user can select an inappropriate image to thereby select a unitregion that needs re-imaging, while viewing the images r1 to r6 of theplurality of imaged unit regions.

Based on the selection instruction by the user and the positionalinformation stored in the storage unit 240, the selected unit region isre-imaged, and the image data stored in the storage unit 240 is replacedwith the re-imaged data. Finally, connected image data is generatedbased on the plurality of pieces of image data and the re-imaged datastored in the storage unit 240.

This can eliminate the need for re-imaging all the unit regions evenwhen part of the plurality of unit regions is not appropriatelyobtained. Consequently, in the case of re-imaging the observation objectS to obtain connected image data corresponding to a plurality of unitregions, the connected image data can be efficiently obtained in a shortperiod of time.

As described above, in the present embodiment, image data correspondingto the unit region to be re-imaged among the plurality of pieces ofimage data stored in the storage unit 240 of FIG. 1 is replaced with there-imaged data at the time of re-imaging. This eliminates the need forthe user to perform the operation for replacing the image data. Hence,connected image data including the re-imaged data can be obtained withease.

Instead of replacing the image data with re-imaged data at the time ofre-imaging, image data corresponding to the acquired re-imaged data maybe stored into the storage unit 240 in a replaceable state. In thiscase, the user may operate the input unit 250 of FIG. 1 to replace theimage data with the re-imaged data.

In the magnification observation process according to the presentembodiment, the plurality of unit regions are sequentially imaged in thespiral form such that regions around the first unit region are imaged bythe connected image generating operation, and the connection end button425 is operated, to complete the magnification observation process. Inthis case, the user can decide with ease the observation object range ofthe observation object S that needs imaging without previously settingan imaging range, while viewing the plurality of images displayed in thedisplay part 260.

In the present embodiment, after the selection of the unit region to bere-imaged, the unit regions subsequent to the selected unit region arealso sequentially re-imaged. Thereby, the plurality of subsequent unitregions are re-imaged only by one-time selection instruction by theuser. This simplifies the operation for the selection instruction forthe unit region, performed by the user.

As described above, at the time of re-imaging, the CPU 220 may re-imageonly the selected unit region instead of sequentially re-imaging theselected unit region and the subsequent unit regions. In this case, theimaging condition may be appropriately adjusted with respect to eachunit region.

(5) Flow of Magnification Observation Process According to FirstEmbodiment

FIGS. 12 and 13 are flowcharts of the magnification observation processaccording to the first embodiment. The CPU 220 of FIG. 1 executes amagnification observation program to be stored into the storage unit240, to perform the magnification observation process according to thepresent embodiment. In the following flowchart, there will be describedan example of re-imaging only a unit region corresponding to an imageselected at the time of re-imaging.

In an initial state, previously fixed imaging conditions (gain of thecolor CCD 11, exposure time, white balance, focal position of the objectlens 13, and the like) are set in the magnification observation device300 by the user's operation.

First, the CPU 220 images a first unit region of the observation objectS on the previously set imaging conditions, to acquire image datacorresponding to the first unit region and generate first positionalinformation indicative of a position of the first unit region, andstores the acquired image data into the storage unit 240 of FIG. 1 alongwith the first positional information (step S1). Further, the CPU 220displays an image of the first unit region in the display part 260 ofFIG. 1 based on the acquired image data and the first positionalinformation (step S2).

Next, the CPU 220 determines whether or not a command for re-imaging hasbeen issued (step S3). For example, the CPU 220 determines that thecommand for re-imaging has been issued when the re-imaging button 424 ofFIG. 7 is operated, and determines that the command for re-imaging hasnot been issued when the re-imaging button 424 is not operated.

When the command for re-imaging has not been issued, the CPU 220determines whether or not a command for completing the magnificationobservation process has been issued (step S4). For example, the CPU 220determines that the command for completing the magnification observationprocess has been issued when the connection end button 425 of FIG. 7, 8,or 10 is operated, and determines that the command for completing themagnification observation process has not been issued when theconnection end button 425 is not operated.

When the command for completing the magnification observation processhas been issued, the CPU 220 stores into the storage unit 240 connectedimage data generated by the plurality of pieces of image data and there-imaged data, and displays connected images in the display part 260based on the connected image data (step S5), to complete themagnification observation process.

On the other hand, when the command for completing the magnificationobservation process has not been issued, the CPU 220 controls the stagedriving part 22 of FIG. 1 to move the stage 21 of FIG. 1 so as to imagethe next unit region (step S6).

The CPU 220 images the next unit region to acquire image datacorresponding to that unit region, and generates positional informationindicative of a position of the unit region, and stores the acquiredimage data into the storage unit 240 of FIG. 1 along with thecorresponding positional information while connecting the acquired imagedata to the image data corresponding to the previously stored anotherunit region (step S7). Further, the CPU 220 displays in the display part260 of FIG. 1 an image of the unit region based on the acquired imagedata and positional information (step S8), and returns to the process ofstep S4.

In step S4 above, when the command for re-imaging has been issued, theCPU 220 displays in the display part 260 images for allowing the user toselect a unit region that needs re-imaging as the region presentationimage (step S9).

As the region presentation image at this time, there may be used aplurality of images based on all of image data acquired after the startof the magnification observation process and mutually connected to eachother, or there may be used a plurality of images based on part of theimage data acquired after the start of the magnification observationprocess and mutually connected to each other. Further, as the regionpresentation image, for example, there may be used images in which aplurality of non-connected images based on the plurality of pieces ofimage data are arrayed at fixed intervals.

Thereafter, the CPU 220 determines whether or not any imaged unit regionhas been selected as a re-imaging object (step S10).

Specifically, by selection of any of the plurality of images displayedin the display part 260 based on an operation of the input unit 250 bythe user, the CPU 220 determines that a unit region that needsre-imaging has been selected.

When any unit region is selected, the CPU 220 controls the stage drivingpart 22 to move the stage 21, so as to image the selected unit regionbased on the positional information stored in the storage unit 240 ofFIG. 1 (step S11).

Subsequently, the CPU 220 images the selected unit region to acquireimage data, and displays an image based on the acquired image data inthe display part 260 (step S12). In this state, the CPU 220 receives theabove adjustment instruction for the imaging condition, to adjust animaging condition based on the provided adjustment instruction (stepS13).

Specifically, by operation of a plurality of buttons (re-imagingdecision button 426, gain adjustment button 427 a, exposure time button427 b, white balance button 427 c, and focus button 427 d) of FIG. 9 bythe user, the CPU 220 adjusts a variety of imaging conditions based onthe provided adjustment instruction. It is to be noted that, when thereis no previously set adjustment instruction for a predetermined periodof time, the CPU 220 does not adjust the imaging condition.

Thereafter, the CPU 220 re-images the selected unit region on theimaging condition after the adjustment, to acquire re-imaged datacorresponding to the selected unit region, and stores positionalinformation corresponding to the re-imaged data into the storage unit240 (step S14).

Next, the CPU 220 replaces image data of the selected unit region withthe acquired re-imaged data in the storage unit 240, and connects theacquired re-imaged data to another image data (step S15).

Subsequently, the CPU 220 displays in the display part 260 an image ofthe unit region selected based on the acquired re-imaged data andpositional information (step S16), and returns to the process of stepS4.

In the flowcharts of FIGS. 12 and 13, for example, a series ofprocessing operations including steps S4, S6, S7, and S8 corresponds tothe connected image generating

[2] Second Embodiment

Concerning a magnification observation device, a magnificationobservation method, and a magnification observation program according toa second embodiment, a difference from those in the first embodimentwill be described.

The magnification observation device according to the second embodimenthas the same configuration as that of the magnification observationdevice 300 of FIG. 1, but has a different magnification observationprogram that is stored in the storage unit 240. For this reason, themagnification observation process according to the second embodiment isdifferent from the magnification observation process according to thefirst embodiment. Hereinafter, a detail of the magnification observationprocess according to the second embodiment will be described.

(1) Magnification Observation Process According to Second Embodiment

In the present embodiment as well, when the observation object S isimaged, a similar image to that of FIG. 5 or 6 is displayed in thedisplay part 260 of FIG. 1 in accordance with a magnification of theobject lens 13. In this state, the user operates the connection processbutton 423 of FIG. 5 or 6 by use of the input unit 250 of FIG. 1, andthe magnification observation process is thereby started.

There will be described the magnification observation process performedwith the magnification of the object lens 13 being set to the firstmagnification, namely, the magnification observation process in the caseof generating images corresponding to a plurality of unit regions at thefirst magnification.

First, an observation object range of the observation object S thatneeds imaging is set. For example, the user inputs information on theobservation object range by use of the input unit 250 of FIG. 1. Basedon the input information, the CPU 220 of FIG. 1 sets the observationobject range of the observation object S. Further, when the observationobject range is larger than the unit region, the CPU 220 sets positionsof a plurality of unit regions that need imaging within the setobservation object range. Thereafter, the CPU 220 controls eachconstitutional element of the microscope 100 so as to sequentially imagethe plurality of set unit regions.

In the present embodiment, at the time of setting the above observationobject range, the observation object S is imaged at the secondmagnification which is lower than the first magnification. In this case,the CPU 220 acquires image data corresponding to the unit region at thetime of the second magnification being set, and generates positionalinformation indicative of a position of that unit region, to store theacquired image data into the storage unit 240 of FIG. 1 along with thepositional information.

At this time, the second magnification of the object lens 13 may be, forexample, automatically set by the CPU 220 at the start of setting theobservation object range, or set by the user operating the zoomadjusting part 13 a of FIG. 1 before the start of setting theobservation object range.

In the present embodiment, the CPU 220 automatically sets the imagingcondition at the start of imaging each unit region during themagnification observation process. This automatic setting will bespecifically described. In the following specific example, the CPU 220automatically sets the Z position of the object lens 13 as automaticsetting of the imaging condition.

At the start of imaging each unit region, the CPU 220 controls the lensdriving part 17 of FIG. 1 with the unit region opposed to the objectlens 13, to move the object lens 13 in the Z-direction, and images theunit region while moving a focal position of the object lens 13 in theZ-direction. At this time, the CPU 220 detects the Z position(hereinafter, referred to as focal position) of the object lens 13 whenthe focus of the object lens 13 agrees with the surface of the unitregion based on the image data provided from the A/D converter 15.Subsequently, the CPU 220 moves the object lens 13 to the detected focalposition. In such a manner, the Z position of the object lens 13 at thetime of imaging is set to the focal position.

In this case, the unit region is imaged with the Z position of theobject lens 13 automatically set to the focal position. Since the unitregion is thus imaged with the object lens 13 in an in-focus state, theuser can obtain with ease an in-focus image with respect to each unitregion.

On the other hand, the focal position is not necessarily detected. Forexample, when a large step is present on the surface of the observationobject S within one unit region, it may not be possible to detect afocal position with respect to the unit region. When the focal positionis not detected, the CPU 220 sets the Z position of the object lens 13to a previously set position (e.g., position set in the previouslyimaged unit region, or the like), and stores information (hereinafter,referred to as abnormal information) indicating that the imagingcondition (Z position of the object lens 13 in the present example) hasnot been normally set in the unit region into the storage unit 240 ofFIG. 1.

As described above, by imaging of all the unit regions within theobservation object range, a plurality of pieces of image datarespectively corresponding to all the unit regions are stored into thestorage unit 240 along with a plurality of pieces of respectivelycorresponding positional information. When a focal position is notdetected in part or all of the unit regions, abnormal information on thepart or all of the unit regions is stored into the storage unit 240.

As described above, after imaging of all the unit regions within theobservation object range, the CPU 220 displays in the display part 260of FIG. 1 an image (hereinafter, referred to as a low-magnificationimage) which has been acquired by imaging the observation object S atthe second magnification at the time of setting the observation objectrange and is based on the image data stored in the storage unit 240, asa region presentation image. In the present embodiment, the secondmagnification is preferably set such that the low-magnification imagedisplayed in the display part 260 includes the entire image in theobservation object range.

FIG. 14 is a view showing a display example of the display part 260during the magnification observation process according to the secondembodiment. As shown in FIG. 14, in the magnification observationprocess according to the second embodiment, all the unit regions withinthe observation object range are imaged, to display a low-magnificationimage of the observation object S as a region presentation image in theimage display region 410.

In this state, the CPU 220 of FIG. 1 displays within the image displayregion 410 a plurality of region frames f surrounding portionscorresponding to the plurality of unit regions imaged at the firstmagnification. Thereby, in the example of FIG. 14, the low-magnificationimage displayed within the image display region 410 is partitioned bythe plurality of region frames f into twenty-five low-magnificationimages t1 to t25.

Further, based on the abnormal information stored in the storage unit240, the CPU 220 determines whether or not the imaging condition hasbeen normally set in each unit region. Thus, the CPU 220 determineswhether or not the imaging condition has been normally set in each unitregion, and highlights the low-magnification image (low-magnificationimages t2, t6 in the example of FIG. 14) corresponding to the unitregion determined not to have been normally set with the imagingcondition, based on the positional information stored in the storageunit 240. FIG. 14 presents the highlights by dark hatching.

This facilitates the user to recognize that the imaging condition hasnot been normally set in the unit regions corresponding to thehighlighted low-magnification images t2, t6, and those unit regions werethereby not imaged on an appropriate imaging condition (Z position ofthe object lens 13 in this example). At this time, the re-imaging button424 and the connection end button 425 are displayed in the conditionsetting region 420.

In the present embodiment, the region presentation image is used forshowing the unit region having not been normally set with the imagingcondition. For this reason, differently from the first embodiment, it isnot necessary in the second embodiment to display in the display part260 a plurality of images based on image data acquired by imaging at thefirst magnification.

Also in the magnification observation process according to the presentembodiment, the user can operate the re-imaging button 424 of FIG. 14,to thereby selectively re-image any of the plurality of imaged unitregions at the first magnification.

For example, when the user operates the re-imaging button 424, the CPU220 comes into a standby state until receiving a selection instruction.In this state, the user selects any of the low-magnification images t1to t25 displayed in the image display region 410 by use of the pointerp. Thereby, the CPU 220 is provided with a selection instructionindicative of a unit region that needs re-imaging among the plurality ofunit regions corresponding to the low-magnification images t1 to t25.

As described above, in the present embodiment, the low-magnificationimages t2, t6 portions corresponding to the unit regions having not beennormally set with the imaging condition are highlighted. Therefore, theuser can view the highlighted low-magnification images t2, t6, tothereby preferentially select the unit region having not been normallyset with the imaging condition as the unit region that needs re-imaging.

The user selects the low-magnification image t6, to provide the CPU 220with a signal indicative of the unit region corresponding to thelow-magnification image t6 as the selection instruction. In this case,the CPU 220 images the selected unit region at the first magnificationbased on the provided selection instruction and the positionalinformation stored in the storage unit 240. Further, similarly to theexample of FIG. 9, the CPU 220 displays the low-magnification image t6in the entire region of the image display region 410, and displays there-imaging decision button 426, the gain adjustment button 427 a, theexposure time button 427 b, the white balance button 427 c, and thefocus button 427 d in the condition setting region 420.

In this state, the user can operate the gain adjustment button 427 a,the exposure time button 427 b, the white balance button 427 c, and thefocus button 427 d, to thereby adjust the imaging conditions for theunit region.

Thereafter, the CPU 220 re-images the selected unit region on theimaging condition after the adjustment, to acquire re-imaged data, andstores the acquired re-imaged data into the storage unit 240 of FIG. 1.Further, the CPU 220 generates positional information corresponding tothe re-imaged data, and stores the generated position information intothe storage unit 240. At this time, the CPU 220 replaces the image datacorresponding to the previously stored unit region with the re-imageddata.

Subsequently, the CPU 220 returns the displayed state of the displaypart 260 to the display state of FIG. 14 again. In this case, the usercan operate the re-imaging button 424 again while selecting thelow-magnification image t2, to thereby re-image the unit region of theobservation object S which corresponds to the low-magnification image t2at the first magnification.

When the user finally operates the connection end button 425 of FIG. 14,the CPU 220 connects between the plurality of pieces of image data andthe re-imaged data which are stored in the storage unit 240, to generateconnected image data corresponding to the observation object range. TheCPU 220 displays in the display part 260 a connected image in theobservation object range based on the connected image data, whilestoring the generated connected image data into the storage unit 240,and completes the magnification observation process. At this time, theCPU 220 stores into the storage unit 240 positional information of eachunit region along with the plurality of pieces of image data and there-imaged data that constitute the connected image data.

(2) Effects

In the present embodiment, the low-magnification image is used as theregion presentation image for the user to select a unit region thatneeds re-imaging. In this case, the low-magnification image can bedisplayed by means of a small capacity of image data. This eliminatesthe need for spending a long period of time on generation of image datafor displaying the low-magnification image. Further, it is possible toprevent an amount of the image data for displaying the low-magnificationimage from exceeding a usable capacity of the operation memory 270 ofFIG. 1.

At the start of imaging each unit region, the Z position of the objectlens 13 is automatically set to the focal position as the imagingcondition. When the focal position of the object lens 13 is notdetected, abnormal information indicating that the imaging condition hasnot been normally set in the unit region is stored into the storage unit240. Based on the stored abnormal information, it is determined whetheror not the imaging condition has been normally set in each unit region.A portion of the low-magnification image which corresponds to the unitregion having not been normally set with the imaging condition ishighlighted. Thereby, the user can view the low-magnification imageincluding the highlight, to thereby recognize with ease the unit regionhaving not been normally set with the imaging condition. Therefore, theuser can re-image with ease the unit region having not been normally setwith the imaging condition.

(3) Flow of Magnification Observation Process According to SecondEmbodiment

FIGS. 15 and 16 are flowcharts of the magnification observation processaccording to the second embodiment. The CPU 220 of FIG. 1 executes themagnification observation process in accordance with the magnificationobservation program stored in the storage unit 240 of FIG. 1.

In the present example, the magnification of the object lens 13 is setto the second magnification in an initial state. Further, in the initialstate, previously fixed imaging conditions (gain of the color CCD 11,exposure time, white balance, and the like) are set in the magnificationobservation device 300 by the user's operation. It is to be noted thatthe Z position of the object lens 13 of FIG. 1 has not been set in theinitial state.

First, the CPU 220 sets the observation object range, and images theobservation object S at the second stage, to store the acquired imagedata into the storage unit 240 of FIG. 1 along with positionalinformation corresponding thereto (step S21). As described above, theCPU 220 sets the observation object range of the observation object Sbased on, for example, information inputted from the input unit 250 ofFIG. 1. Further, when the observation object range is larger than theunit region, the CPU 220 sets positions of a plurality of unit regionsthat need imaging within the set observation object range.

After the process of step S21, the magnification of the object lens 13is changed from the second magnification to the first magnification bythe user operating the input unit 250 of FIG. 1 or by the user operatingthe zoom adjusting part 13 a of FIG. 1.

Next, the CPU 220 automatically sets the imaging condition with respectto a first unit region of the observation object S (step S22). In thepresent example, the CPU 220 automatically sets the Z position of theobject lens 13 as the imaging condition. As described above, the CPU 220stores the above abnormal information into the storage unit 240 whenbeing unable to detect the focal position of the object lens 13 at thetime of automatic setting.

Subsequently, the CPU 220 images a first unit region with the Z positionof the object lens 13 in the automatically set state, to acquire imagedata corresponding to the first unit region, generates first positionalinformation indicative of a position of the first unit region, andstores the acquired image data into the storage unit 240 along with thefirst positional information (step S23).

Next, the CPU 220 determines whether or not all the unit regions withinthe observation object range, set in step S21, have been imaged (stepS24). Specifically, the CPU 220 determines whether or not a plurality ofpieces of image data corresponding to all the unit regions within theobservation object range have been stored into the storage unit 240.

When all the unit regions within the observation object range are notimaged, the CPU 220 controls the stage driving part 22 of FIG. 1 to movethe stage 21 of FIG. 1 so as to image the next unit region of theobservation object S (step S25).

Similarly to step S22 above, the CPU 220 automatically sets the imagingcondition with respect to the next unit region to be imaged (step S26).Further, the CPU 220 stores the above abnormal information into thestorage unit 240 when being unable to detect the focal position of theobject lens 13 at the time of automatic setting.

Next, the CPU 220 images the next unit region with the Z position of theobject lens 13 in the automatically set state, to thereby acquire imagedata corresponding to that unit region, and stores the acquired imagedata into the storage unit 240 along with positional informationcorresponding to the acquired image data (step S27). Thereafter, the CPU220 returns to the process of step S24.

In step S24, when all the unit regions within the observation objectrange are imaged, the CPU 220 displays in the display part 260 alow-magnification image based on the image data stored into the storageunit 240 in step S21 as the region presentation image (step S31). It isto be noted that the CPU 220 may perform the following process insteadof storing the image data into the storage unit 240 in step S21.

For example, when all the unit regions within the imaging range areimaged in step S24, the CPU 220 may change the magnification of theobject lens 13 to the second magnification which is lower than the firstmagnification, and images the observation object S at the secondmagnification. In this case, the CPU 220 can display in the display part260 a low-magnification image based on the acquired image data as theregion presentation image.

Subsequently, when the abnormal information is stored in the storageunit 240, the CPU 220 determines whether or not the imaging conditionhas been normally set in each unit region based on the stored abnormalinformation, and highlights a portion of the low-magnification imagewhich corresponds to a unit region having not been normally set with theimaging condition (step S32).

It should be noted that, instead of the highlight, the CPU 220 maydisplay a letter, a symbol, a frame, or the like in the portion of thelow-magnification image which corresponds to the unit region having notbeen normally set with the imaging condition. In this case, the user canview the letter, the symbol, the frame, or the like, to therebyrecognize with ease the unit region having not been imaged on anappropriate condition.

Next, the CPU 220 determines whether or not a command for re-imaging hasbeen issued (step S33). For example, the CPU 220 determines that thecommand for re-imaging has been issued when the re-imaging button 424 ofFIG. 14 is operated, and determines the command for re-imaging has notbeen issued when the re-imaging button 424 is not operated. When thecommand for re-imaging has not been issued, the CPU 220 proceeds to aprocess of step S40, to be described later.

On the other hand, when the command for re-imaging has been issued, theCPU 220 determines whether or not any imaged unit region has beenselected as a re-imaging object, while displaying the low-magnificationimage in the display part 260 (step S34).

When any unit region is selected, the CPU 220 controls the stage drivingpart 22 to move the stage 21, so as to image the selected unit regionbased on the positional information stored in the storage unit 240 ofFIG. 1 (step S35).

Subsequently, the CPU 220 images the selected unit region to acquireimage data, and displays an image based on the acquired image data inthe display part 260 (step S36). In this state, the CPU 220 receives theadjustment instruction for the imaging condition, to adjust an imagingcondition based on the provided adjustment instruction (step S37).Specifically, similarly to the first embodiment, by operation of aplurality of buttons (re-imaging decision button 426, gain adjustmentbutton 427 a, exposure time button 427 b, white balance button 427 c,and focus button 427 d) of FIG. 9 by the user, the CPU 220 adjusts avariety of imaging conditions based on the provided adjustmentinstruction.

Thereafter, the CPU 220 images the selected unit region of theobservation object S on the imaging condition after the adjustment, toacquire re-imaged data corresponding to the selected unit region, andstores positional information corresponding to the re-imaged data intothe storage unit 240 (step S38). Further, the CPU 220 replaces the imagedata of the selected unit region with the acquired re-imaged data in thestorage unit 240 (step S39).

Next, the CPU 220 determines whether or not a command for completing themagnification observation process has been issued (step S40). Forexample, the CPU 220 determines that the command for completing themagnification observation process has been issued when the connectionend button 425 of FIG. 14 is operated, and that the command forcompleting the magnification observation process has not been issuedwhen the connection end button 425 is not operated.

When the command for completing the magnification observation processhas been issued, the CPU 220 connects between the plurality of pieces ofimage data and the re-imaged data which are stored in the storage unit240, to generate connected image data, and displays a connected imagebased on the connected image data in the display part 260 while storingthe generated connected image data into the storage unit 240 (step S41).Thereby, the magnification observation process is completed. On theother hand, when the command for completing the magnificationobservation process has not been issued, the CPU 220 returns to theprocess of step S33.

[3] Other Embodiments

(1) In the first and second embodiments, the magnification observationprocess is performed in the magnification observation device 300provided with the microscope 100 for observing the surface of theobservation object S by use of white light. These are not restrictive,and the magnification observation process can be applied to anothermagnification observation device that enlarges the surface of theobservation object S and observes the enlarged surface. As such amagnification observation device, for example, there are a magnificationobservation device provided with a microscope using opticalinterferometry, a magnification observation device provided with aconfocal microscope, a magnification observation device provided with anelectron scanning microscope, a magnification observation deviceprovided with a scanning probe microscope, and a magnificationobservation device provided with a fluorescence microscope, and thelike.

(2) In the first and second embodiments, as the examples of theadjustment instruction for the imaging condition for the unit region,there were described the adjustment instruction for the gain of thecolor CCD 11 of FIG. 1, the adjustment instruction for the exposuretime, the adjustment instruction for white balance, and the adjustmentinstruction for the Z position of the object lens 13. These are notrestrictive, and the CPU 220 of FIG. 1 may accept the followingadjustment instruction as the adjustment instruction for the imagingcondition for the unit region of the observation object S.

(2-1) The CPU 220 may accept an adjustment instruction for relativepositions of the observation object S and the object lens 13 in theX-direction and the Y-direction as the adjustment instruction for theimaging condition of the unit region. In this case, the CPU 220 controlsthe stage driving part 22 of FIG. 1 based on the adjustment instruction,to move the stage 21 in the x-direction and the y-direction.

(2-2) As the adjustment instruction for the imaging condition for theunit region, the CPU 220 may accept an adjustment instruction for alight amount of the illumination light source 16 of FIG. 1 or anadjustment instruction with regard to an opening of a diaphragm (notshown) or a transmittance of a filter (not shown). In this case, the CPU220 adjusts the light amount of the illumination light source 16, theopening of the diaphragm (not shown) or the transmittance of the filter(not shown) based on the adjustment instruction.

(2-3) When an amount of reflected light from the surface of theobservation object S is large, an electric signal of the color CCD 11may be saturated. In this case, acquired image data indicates themaximal value. For this reason, even when an image based on the acquiredimage data is displayed, the user cannot recognize the state of thesurface of the observation object S. Thereat, the gain of the color CCD11 can be set low, to thereby prevent saturation of the electric signalof the color CCD 11.

On the other hand, when the level of the electric signal of the colorCCD 11 becomes too low due to a small amount of the reflected light fromthe surface of the observation object S, image data acquired based onthe reflected light cannot be accurately identified. Thereat, the gainof the color CCD 11 can be set high, to make the level of the electricsignal of the color CCD 11 high, thereby accurately identifying theimage data.

There may be cases where a region with a large amount of reflected light(hereinafter, referred to as high-reflection region) is mixed with aregion with a small amount of reflected light (hereinafter, referred toas low-reflection region), depending on the state of the surface of theobservation object S. When the high-reflection region and thelow-reflection region are included within a region to be imaged, thestate of the surface of the observation object S cannot be accuratelyobserved unless the gain of the color CCD 11 is set to a different valuewith respect to each of the high-reflection region and thelow-reflection region.

Hence, there is a method of sequentially imaging one region with aplurality of mutually different gains to acquire a plurality of piecesof image data, and synthesizing the acquired image data to generatesynthesized image data corresponding to the region. Hereinafter, thismethod is referred to as a wide dynamic range.

According to the wide dynamic range, even when the region includes thehigh-reflection region and the low-reflection region, image dataacquired with an appropriate gain corresponding to the high-reflectionregion and image data acquired with an appropriate gain corresponding tothe low-reflection region can be synthesized, and it is thereby possibleto accurately observe the state of the surface of the observation objectS in the region.

In the magnification observation device 300 according to the first andsecond embodiment, when the function of the wide dynamic range isapplied to the magnification observation process, the CPU 220 may acceptan adjustment instruction for the number of imaging per unit region tobe imaged and the gain of the color CCD 11 at the time of imaging, asthe adjustment instruction for the imaging condition for the unitregion.

In this case, based on the adjustment instruction, the CPU 220 sets thenumber of imaging per unit region to be imaged and the gain of the colorCCD 11 at the time of imaging. This enables accurate observation of thesurface of the observation object S regardless of the state of thesurface of the observation object S.

(2-4) In the confocal microscope, laser light emitted from a laser lightsource is collected to the observation object S by the object lens.Reflected light from the observation object S is collected by thephotoreceptor lens, and incident on a receiving element through a pinhole. While a relative distance between the observation object S and theobject lens is changed, laser light is two-dimensionally scanned on thesurface of the observation object S, to thereby generate a plurality ofpieces of confocal image data corresponding to a plurality of relativedistances between the observation object S and the object lens. Based onthe generated plurality of pieces of confocal image data, ultra-depthimage data or height image data is generated. Based on the ultra-depthimage data or the height image data, an ultra-depth image or a heightimage is displayed in the display part.

As described above, in the magnification observation device providedwith the confocal microscope, a position in the height direction of theobject lens with respect to the observation object S is changed at thetime of imaging each unit region. For example, when the confocalmicroscope is provided instead of the microscope 100 of FIG. 1, the CPU220 may accept an adjustment instruction for a movement range (upperlimit position and lower limit position) in the height direction of theobject lens with respect to the observation object S as the adjustmentinstruction for the imaging condition for the unit region.

In this case, the CPU 220 sets the movement range in the heightdirection of the object lens based on the adjustment instruction. Thisallows appropriate setting of the movement range in the height directionof the object lens.

In the above description, in the magnification observation deviceprovided with the confocal microscope, there has been described theexample of accepting the adjustment instruction for the movement range(upper limit position and lower limit position) in the height directionof the object lens with respect to the observation object S. This is notrestrictive, and also in the magnification observation device 300provided with the microscope 100 for observing the surface of theobservation object S by use of white light, the CPU 220 may accept anadjustment instruction for the movement range (upper limit position andlower limit position) in the height direction of the object lens 13 withrespect to the observation object S as the adjustment instruction forthe imaging condition for the unit region.

(3) In the first and second embodiments, there has been described theexample of moving the stage 21 in the x-direction and the y-direction,to connect the acquired image data of the plurality of unit regions.This is not restrictive, and in the magnification observation deviceprovided with the confocal microscope, a plurality of pieces of confocalimage data may be generated with respect to a plurality of unit regions,and based on the generated plurality of pieces of confocal image data,ultra-depth image data or height image data may be generated, and thegenerated plurality of pieces of ultra-depth image data or height imagedata may be connected, to thereby display in the display part themutually connected ultra-depth images or height images of the pluralityof unit regions.

It should be noted that, even in the magnification observation device300 provided with the microscope 100 for observing the surface of theobservation object S by use of white light, for example, image data ofeach unit region is acquired while the relative distance between theobservation object S and the object lens 13 is changed, thereby allowinggeneration of ultra-depth image data or height image data which isindicative of the position of the surface of the observation object S inthe Z-direction. Therefore, also in the magnification observation device300 as thus described, the ultra-depth image data or the height imagedata of the plurality of unit regions may be connected, to displaymutually connected ultra-depth images or height images of the pluralityof unit regions in the display part 260.

(4) In the second embodiment, the automatic setting of the Z position ofthe object lens 13 has been described as the automatic setting of theimaging condition which is performed at the start of imaging each unitregion. This is not restrictive, and at the start of imaging each unitregion, the CPU 220 may automatically set, as the automatic setting ofthe imaging condition, the gain of the color CCD 11 of FIG. 1, theexposure time, the white balance, the number of imaging per unit regionand the gain of the color CCD 11 at the time of each imaging, themovement range in the height direction of the object lens with respectto the observation object S, and the like.

When an appropriate gain is not detected at the time of automaticallysetting the gain of the color CCD 11, the CPU 220 may store the aboveabnormal information into the storage unit 240 of FIG. 1. Further, whenan appropriate shutter speed is not detected at the time ofautomatically setting the exposure time, the CPU 220 may store the aboveabnormal information into the storage unit 240 of FIG. 1. Moreover, whenan appropriate correction amount of an image data value cannot bedecided at the time of automatically setting the white balance, the CPU220 may store the above abnormal information into the storage unit 240of FIG. 1.

Furthermore, when an appropriate number of imaging is not detected atthe time of automatically setting the number of imaging per unit region,the CPU 220 may store the above abnormal information into the storageunit 240 of FIG. 1. Moreover, when an appropriate movement range (upperlimit position and lower limit position) is not detected at the time ofautomatically setting the movement range in the height direction of theobject lens with respect to the observation object S, the CPU 220 maystore the above abnormal information into the storage unit 240 of FIG.1.

Thereby, the user can view the low-magnification image (regionpresentation image) including the highlight, to recognize with easewhether or not each unit region has been imaged with a variety ofimaging conditions in an appropriately set state.

(5) In the second embodiment, the imaging condition is automatically setat the start of imaging each unit region, and a unit region having notbeen normally set with the imaging condition is highlighted in theregion presentation image.

This is not restrictive, and the CPU 220 may image a plurality of unitregions on a previously set imaging condition at the start of themagnification observation process, to thereby acquire image datacorresponding to each unit region, and may determine whether or not theimage of each unit region displayed in the display part 260 satisfiesthe previously set condition based on the acquired plurality of piecesof image data.

For example, when a total amount of brightness (brightness values) of aplurality of pixels in an image in each unit region has been set to bewithin a fixed range as the previously set condition, the CPU 220 maydetermine whether or not a total amount of brightness (brightnessvalues) of a plurality of pixels in the image of each unit region iswithin the fixed range, and may highlight in the region presentationimage the unit region of the image with the total of brightness of theplurality of pixels exceeding the fixed range.

Further, when a contrast ratio in the image of each unit region has beenset within a fixed range as the previously set condition, the CPU 220may determine whether or not the contrast ratio in the image of eachunit region is within the fixed range, and may highlight in the regionpresentation image the unit region of the image with the contrast ratioexceeding the fixed range.

In these cases, the user can view the region presentation image, tothereby recognize with ease whether the image of each unit regionsatisfies the previously set condition. Therefore, the user can selectany unit region shown in the region presentation image based on thehighlight, to thereby re-image with ease the unit region in which animage satisfying the previously set condition has not been obtained.

(6) In the first embodiment, the imaging condition may be automaticallyset at the start of imaging each unit region. In this case, similarly tothe second embodiment, an indicator (highlighted image, letter, symbol,frame, or the like) indicative of the unit region having not been imagedon an appropriate imaging condition may be displayed in the regionpresentation image.

(7) In the first and second embodiment, the object lens 13 is moved inthe Z-direction, to thereby change a relative position in theZ-direction of the observation object S with respect to the objectivelens 3, but this is not restrictive. The stage 21 may be moved in theZ-direction, to thereby change the relative position in the Z-directionof the observation object S with respect to the object lens 13.

[4] Corresponding Relations Between Each Constitutional Element ofClaims and Each Part of Embodiments

Although an example of correspondence between each constitutionalelement of the claims and each part of the embodiments will behereinafter described, the present invention is not limited to thefollowing example.

In the above embodiment, the observation object S is an example of theobject, the magnification observation device 300 is an example of themagnification observation device, the imaging unit 10 is an example ofthe imaging part, the storage unit 240 is an example of the storagepart, the CPU 220 is an example of the positional information generatingpart, the connecting part, the control part, the determination part, andthe processing apparatus, the display part 260 is an example of thedisplay part, and the CPU 220 and the input unit 250 are examples of theaccepting part.

As each constitutional element of the claims, a variety of otherelements having the configuration or the function described in theclaims can be employed.

The present invention is effectively applicable to magnificationobservation devices using a variety of microscopes.

1. A magnification observation device which images an object to displayan image of the object, the device comprising: an imaging portionconfigured to respectively image a plurality of unit regions of anobject to generate a plurality of pieces of image data respectivelycorresponding to the plurality of unit regions; a display portionconfigured to display an image based on the plurality of pieces of imagedata; an accepting portion configured to accept an selection instructionrepresenting an area on the image displayed by the display portion tore-image a unit region of an object to regenerate a piece of image datacorresponding to the unit region; and a control portion configured tocontrol the imaging portion to perform a re-imaging which is to re-imagea unit region of an object corresponding to the selection instruction togenerate a piece of image data corresponding to the unit region, and tocontrol the display portion to display an image based on the pluralityof pieces of image data partially replaced with the piece of image datagenerated by the re-imaging.
 2. The magnification observation deviceaccording to claim 1, further comprising a memory configured to storethe plurality of pieces of image data generated by the imaging portion,a connecting portion configured to connect the plurality of pieces ofimage data stored in the memory to generate connected image data, andwherein the display portion displays a connected image based on theconnected image data as the image based on the plurality of pieces ofimage data.
 3. The magnification observation device according to claim1, wherein, when the selection instruction is accepted by the acceptingpart, the control part replaces the image data corresponding to theselected unit region among the image data corresponding to the pluralityof unit regions stored in the storage part with the image data generatedby the re-imaging.
 4. The magnification observation device according toclaim 1, further comprising a positional information generating portionconfigured to generate a positional information representing arespective positions of the plurality of unit regions, a memoryconfigured to store the plurality of pieces of image data generated bythe imaging portion associated with the positional information generatedby the positional information generating portion, wherein the controlportion controls the imaging portion to performing a re-imaging which isto re-image a unit region of an object corresponding to the selectioninstruction and the position information stored in the memory togenerate a piece of image data corresponding to the unit region.
 5. Themagnification observation device according to claim 1, wherein theaccepting portion configured to further accept an adjustment instructionfor adjusting an imaging condition of the imaging portion, and when theselection instruction is accepted by the accepting portion, the controlportion controls the imaging portion so as to perform the re-imaging onthe imaging condition adjusted in accordance with the adjustmentinstruction to generate a piece of image data corresponding to the unitregion.
 6. The magnification observation device according to claim 1,further comprising a connecting portion configured to sequentiallyconnect the generated image data to previously generated image datacorresponding to another unit region, and wherein the display portionsequentially displays a connected image based on the sequentiallyconnected image data as the image based on the plurality of pieces ofimage data.
 7. The magnification observation device according to claim6, wherein, when the selection instruction is accepted by the acceptingportion, the control part controls the connected portion so as tosuspend the connection of the image data.
 8. The magnificationobservation device according to claim 1, wherein the imaging portionimages the object at a first magnification and a second magnificationlower than the first magnification, and respectively images theplurality of unit regions at the first magnification to generate aplurality of pieces of image data corresponding to the plurality of unitregions, and the display portion displays images based on image datagenerated by imaging at the second magnification by the imaging portionas the image based on the plurality of pieces of image data.
 9. Themagnification observation device according to claim 1, furthercomprising a determination portion configured to determines whether ornot the image of each unit region satisfies the preset condition basedon the image data corresponding to each unit region, wherein the controlportion controls the display portion so as to display an indicator onthe image based on the plurality of pieces of image data, the indicatorfor identifying an image of unit region having been determined by thedetermination portion not to satisfy the preset condition.
 10. Amagnification observation method for imaging an object to display animage of the object, the method comprising the steps of; respectivelyimaging a plurality of unit regions of an object to generate a pluralityof pieces of image data respectively corresponding to the plurality ofunit regions; displaying an image based on the plurality of pieces ofimage data; accepting an selection instruction representing an area onthe image in a displayed state to re-image a unit region of an object toregenerate a piece of image data corresponding to the unit region;re-imaging a unit region of an object corresponding to the selectioninstruction to generate a piece of image data corresponding to the unitregion; and displaying an image based on the plurality of pieces ofimage data partially replaced with the piece of image data generated inthe re-imaging state.
 11. A magnification observation program forcausing a processing apparatus to execute a process of imaging an objectto display an image of the object, the program comprising the processesof respectively imaging a plurality of unit regions of an object togenerate a plurality of pieces of image data respectively correspondingto the plurality of unit regions; displaying an image based on theplurality of pieces of image data; accepting an selection instructionrepresenting an area on the image in a displayed state to re-image aunit region of an object to regenerate a piece of image datacorresponding to the unit region; re-imaging a unit region of an objectcorresponding to the selection instruction to generate a piece of imagedata corresponding to the unit region; and displaying an image based onthe plurality of pieces of image data partially replaced with the pieceof image data generated in the re-imaging state.